Mutual information via thermodynamics: three different approaches
نویسندگان
چکیده
منابع مشابه
Shannon Meets Carnot: Mutual Information Via Thermodynamics
In this contribution, the Gaussian channel is represented as an equivalent thermal system allowing to express its input-output mutual information in terms of thermodynamic quantities. This thermodynamic description of the mutual information is based upon a generalization of the 2 thermodynamic law and provides an alternative proof to the Guo-Shamai-Verdú theorem, giving an intriguing connection...
متن کاملMeasuring Dependence via Mutual Information
Considerable research has been done on measuring dependence between random variables. The correlation coefficient [10] is the most widely studied linear measure of dependence. However, the limitation of linearity limits its application. The informational coefficient of correlation [17] is defined in terms of mutual information. It also has some deficiencies, such as it is only normalized to con...
متن کاملGeneralized Entropy from Mixing: Thermodynamics, Mutual Information and Symmetry Breaking
We review a new form of entropy suggested by us, with origin in mixing of states of systems due to interactions and deformations of phase cells. It is demonstrated that this nonextensive form also leads to asymmetric maximal entropy configurations unlike Shannon entropy. We discuss how, beginning with quantum entanglement of microsystems with one another and with the environment, one can obtain...
متن کاملSequence Comparisons via Algorithmic Mutual Information
One of the main problems in DNA and protein sequence comparisons is to decide whether observed similarity of two sequences should be explained by their relatedness or by mere presence of some shared internal structure, e.g., shared internal tandem repeats. The standard methods that are based on statistics or classical information theory can be used to discover either internal structure or mutua...
متن کاملMultimodal unbiased image matching via mutual information
In the past decade, information theory has been studied extensively in computational imaging. In particular, image matching by maximizing mutual information has been shown to yield good results in multimodal image registration. However, there have been few rigorous studies to date that investigate the statistical aspect of the resulting deformation fields. Different regularization techniques ha...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Journal of Statistical Mechanics: Theory and Experiment
سال: 2010
ISSN: 1742-5468
DOI: 10.1088/1742-5468/2010/01/p01014